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ABSTRACT 

::u an attempt to ascertain the facilitating functions 
of audiovisual fcetween-cbannel redundancy in information processing, 
a series of audiovisual experiments alternating auditory and visual 
as the dominant and redundant channels were conducted. As predicted, 
results generally supported the between-channel redundancy when input 
(stimulus) was beyond the human information processing capacity. Data 
were also interpreted in terms of various theories such as the lower 
threshold, summation, energy integration, cumulative strength, cuing, 
and multiple traces of the audiovisual bisensory presentation, 
implicitly supporting between-channel redundancy. Evidence obtained 
from the study was also dismetrically opposite to the hypothesis that 
short-terra memory was essentially an auditory system. Based on 
findings in neurophysiology, it was argued that both short-term 
memory and .long-term memory might very well be integrated systems. 
Some conflicting evidence was also found on the position of redundant 
information of one channel in relation to the other channel. 
Pedundant information coinciding with the dominant channel in the 
beginning was found significantly better than that at the end with 
the digit-recall tasks, but not with letter-recall tasks. 
(Author/SW) 
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Audiovisucil 8etW(^en-*Chann<il Redundancy 
And Us Effects upon Immediate Recall and Short-term Memory 

J, Hsici> Texas Tech University 
ABSTRACT 

In an attempt to aiscertaln the facliitating functions of audio- 
visual between-channel redundancy in inrormation processing, a series of 
audiovisual experiments alternating auditory and visual as the dominant 
and redundant channels were conducted. As predicted, results generally 
supported the between-channal redundancy when input (stimulus) was beyond 
the humon Information processing capacity. Data were also interpreted 
in terms of various theories such as the lower threshold, summation, 
energy Intevjirat ion, cumulative strength, cuing and multiple traces of 
the audiovisu.il bisens,ory presentation, implicitly supporting between- 
channel redundan'zy , 

Evidence obtained from the study was also diametrically opposite to 
the hypothesis that short-term memory was essentially an auditory system. 
Based upon findings in neurophysiology, it was arguea that both short- 
term memory and long-term memory mic,ht very well be integrated systems. 
On the other hand, It might be possible that auditory and visual have 
separate short-term rremory systems. 

Some conflicting evidence was olso found on the position of redundant 
information of one channel in relation io 'che other channel. Redundant 
Information coincided with the dominant channel in the beginning was found 
siynif icantly better than Liiat ^it the end with the Ui^it-recall tasks buc 
not with letter-recall tasks. The discrepancy was probably due to the 
associability of auditory and visual in the letter-recall tasks and the 
difference between the visual forr. and liic ronunc i u L 1 on of the digit- 
reca 1 1 tasks . 
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Man's Information processing capacity (IPC) i i n ite whereas 
the information man must process is infinite. Assuming man is 
an information-seeking animal, searching and processing information 
for his survival, the disparity between his information processing 
capability and his need for information processing must bring about 
a great deal of discomfiture, and more often than not> a sense of 
helplessness when he is confronting the modern world with an 
astronomical amount of information to be processed. To further aggra- 
vate the situation, man possesses various modality IPC, enormously 
greater than the capacity of the central nervous system (CNS) ; eyes, 
for example, can process a million times and ears a thousand times 
more information in bits/second than the CNS (Hsia, 1971) • tven 
though the limited capacity of the CNS is a homeostatic function^ 
to block off unnecessary information so as not to overburden the 
CNS, the inability of processing ull the information that can be 
processea by modality is, indeed > one of the major problem areas 
in communication and education. Therefore, many theories and concepts 
navo emerged, been explored and examined in a hope to improve IPC, 
i.e., to moximi/e the effect i veress of communication defined as a 
commun i CO t i on pr'ocess with the least los^s of in^ormiit^on and error 
(Hsic), 1971). 

Man'', basic IPC is bioloqically ano qenetically limited. There 
is ansolutely no w'jy of f^nlarqing iho IPC o*' ihe CN5, rhat is the 
tjolimltinq factor oT 1 n f(,^r:ncj t ion processing, but there are three 
bo'iif v;av-. ' •.♦c i 1 i lat j 'ig informdtion f)roLes5ing: first, encoding 
nt»ssaqe M' suc'i a way o" tc rr)ake thj ! n I'or ion read] \'/ processable 



for tmKlaliilea and intoyratabUi tor thti CNS, 1'or which Uerncr (1970) 
h«»a eloMuoiUly oxpuufidod ; st^contU rt»Uuclng noise, Interference 
ami unwimtcd Int'ornuit ioi\ to such i\ lijvel that normal procissing ii, 
unhindered (Shannon & Weaver, 19^9) or enhariOiid (ilroaJbent , 1958), 
for on occasion.^ u little noise forced the communicate^' and 
comtnuni cateu to be more attentive; and third, emplrying the redundancy 
principle (H<5ia, '968a, 1968b. 1969, 1973) » in order to facilitate 
communication. 

in his theoretical treatment of redundancy, Hsla (1973) has 
defined many forms of redundancy: (a) Between-channel redundancy, 
(BCR) referring to the redundancy between channels, usually auditory 
and visual channels; (b) dimensional redundancy, referring to the 
redundancy between information dimension; (c) distributional 
redundancy, generally referring to the redundancy 

obtained from the distributional information based upon the 
frequency of occurrence of every element within a sign system; and 
('d; •ieauertial redundancy referring to the redundancy obtained from 
r-e c.jndiiional information which, for example, in a two-letter 
■nessacje. i :> the dependence of the occurrence of one letter upon the 
otn.."r. Apart from BCR, nil other forms of redundancy are within- 
channt?] r t^durvlancy , dealing with content or substance of communication, 
tin(.! explored in numberous linguistic, psy cho I orj i ca I books (e.g., 
i-i^nt.'r, 1962, Ga|-ner 15*^2, ownri others). BCR seems to be an important 
dtc-i overlooked so fcir by many disciplines interested in communication 
i.'i 1 inf'orn.ition process inq. 
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Since rmin Is endowed with a number of information processing 
modfilittes connected with afferrint (input) and efferent (output) 
nervDu^o systems, capable of utilizing any and all receptorsi sensors 
onci tnTijcloib, in uansinittiny and roceivlng informatioru BCR Is a key 
factor in the understanding oF human communication which In most 
cases Involves more than one channel or modality. BCR can be simply 
the similarity of information between auditory and visual, auditory 
and olfactory, auditory and tactile, and olfactory and so on. 
In this study BCR Is a bivariate model of audiovisual communication. 
Conceivably BCR is unity when both auditory and visual channels transmit 
identical information simultaneously; conversely, it is zero when 
the visual and auditory channels emit completely different Information. 
In the former case, communication facilitation takes place, and in 
the latter case, communication Interference breaks out. 

Generally, bCR in this study refers to the similarity of Information 
oetween auditory and visual- -Hsla (1973) has worked out a set of BCR 
formulas as follows: If A and V are the auditory and visual sets of signs, 
all a '5 and v*s arc the elements in the sets, we have 

/\uditory =^a^A |a is the audi tory s ignals^ 

V i s Ud 1 = ^v ^ V I v is the visual si 9"^^ 
Clearly, within each channel, there arc a number of signals or signs, 
i . u . , 

A aj , i = 1 , . . . . , m, 

V = V. , j - 1, 2, n. 

vJU'ilury jnd visual ruf) rescn L a I i uns tiuvu Llutir intormation conLenLs 
.IS cu/> loiHrir i ly defined in accordance with information theory and 
p rcjlnji; i } i t y theory , i.e., 



22 P (aj) « I, and 21 P ^^j^ * ^» 

^nd the anioutu of infur«idtlon U definedj 

H (A) a - £p (flj) Iwg p (a,.)} for the auditory Information, 
H (V) « -SIp (vj) log *p (vj); for the visual Information. 
Apparently the between-channel redundancy cannot be the sum of 
ihe redundancy of the two channels; rather It Is based upon the Joint 
lnforrrt\lon derived from the joint probability. Thus 

E P ^^i. V.) « 1 
an J the joint Information transmitted by both the auditory and visual 

channels is 

H (A,V) = - SI P Vj) P ^^}» ^j) 

If A and V are Identical, I.e., whenever aj appears, Vj also occurs, 

then 

H' (A,V) = log m = log n 
Following precisely the same logic applied to Shannon's redundancy, 
BCR is thus obtained by the conventional formula 

3CR = 1 - ( H(A,V) / H'(A,V)) 

As can seen readily, BCR is characteristically different from 

wi thin-channel redundancy, in addition to its versatility In the 

performance of basic redundancy functions: i.e., to minimize equivocation 

{information loss) and noise (error) in the communication process, BCR 

lakes no more space or time as other forms of redundancy do, ana thereby 

in 

incurs no more cost .informat ion processing than non- redundancy . Any other 
forni of redundancy pays its price in communication, i.e., the more 
redundant a message is, the more time or space it needs for information 
processing, whereas BCR does not. 



Curr^^nt studlua h^ivc v^^pK^tcti mmy thc^wrief. in an Implicit supporl 
of OCR cj 6up«srior mode of stimulus prGHcntiJtiun. irruspectivo of 
the non(.afKlvUura o\' h!fef;nsory» slmuUiineous, tiudiovlsual and othei'^, 
gonori^lly, th« suppoctivt- th^orlch 1'or OCR u-^n bo cateyorizud into 
four iiomev./h.u ove r I app i i-.j '.jroups; (1) lh<^ lowt^r Lhrofihold concept; (?.) 
Uie cuiruj (and also the prcpardtory b tutu) ; (3) thu5 enorgy Integration 
Unciuding sumnuuion, cumulative atronglh bypothesob) ; «nd (^0 tlie multipio- 
trace. 

In a bisensory prei^ei, t at ion , 6ZR v.^i> found to have lowered the 
threshold for information processing and improved auditory threshold 
with a visual accessary stimulus and vic<i versa (Treisman, 196^). The 
lavest threshold was found when ac^essdry stimulus and the signals were 
simultaneous (Treisman 6 Howarth, 1959). BCR, on the other hand, provides 
cues for the whole Intormation processing (Di Vesta ^ Ingersoll, 1969). 
It should be particularly true when Sb are either visual attenders or 
auditory attenders that provides for each according to his lil<es. 
In Lesling the fundamental load-carrying capability of man, Adams and 
Chambers (1962) have found a net superiority of bisensory over unisensory 
responding when stimulu. events were certain, as either channel provides 
cues for the other. Vi.uai delectab i 1 i ty was improved due to the cuing 
ot auditory signal (LoveU-ss, Brebner & Hamilton, 1970). One channel may 
sometimes prepare the other char.nc i for intormation processing (Hintzman & 
dlocis, 1971). 

When thti <->ame i n t urr:-..3l ton i ron'^mi l i^;u inrough two channels and processed 
oy two separate moda i i t. i . it is i^asonublc to a.sumu tne neural impulses, 
. j ; ^y, .....ji ,. i'.'. ! r i . i ' > •:<r.itcM with added stimulus 

intensiUe acros-. niodaliues jru. r.'S.;its in the Joint event to be .riore 



uhuctiv^ly suruiujar than aithur the vibwul or auditory ulohc (BernstclUi 

lD/0; Ugrustoln, Ro^o £ Ashe, 1970). AuUiuviHual proaentatloii tia 

conirobtud tu a oingl(^ modality pro^ientat ian uUo provlUu redundant Input 

based upoi't the summation tht^ory (Lovelusb, et al, 1970). The summation 

tncory of nudiovisuQl prciit^ntut ion inc^y'?l>o^uxp I icatod in tcrmb of cumuUtlvt^ 

strcMujth (Hintiimcan 6 Block, 1971) • 

The mul tiple-tr^cu (Hint^man & Siock, 1971) hypothusis sJS'iumus the 

multiple strength of memory traces, conu rusting to the udded strength oV 

tht? sunmuition or unei-gy Integration hypothtises. If information can bu 

processed within a single trace, it is convksnient to conclude that the 

multiple trace of the audiovisual should be unqeus t ionab ly better than 

the single trace of a single modality, provided that there is no 

not 

interference. Though it i s^necessar i ly correct from a physiological 

viewpoint, the multiple trace concept is consistent with the notion of 

. ve r 

lower threshold and culno^it is howi^in conflict with the argument that 
STM Is an auditory system. 

Laughery and Fell (1969) following a number of studies (Mowbray, 1952, 
Wickoljren, 19^5; bperling, 196/), have argued that short term memory 
(STM) is basically an auditory storage system since Ss performed better 
on auditory i tomr^ regardless of their mode preference, and in^rrectly 
recalled information hatl auditory charac to M s t ics . Therefore, STM 
consists of an encoding of the auditory characteristics of the information 
(bperliiKj, 1367). It follows that vibu«-l ■nTornjalion ur^dergoes a 
t rofv, fi^Miat iof) prior to iti, entry lu STM. 

Wfiethc^r STM is c^uditory is a deijataole issue. If it is true and 
t>inv.e ail i n i onna t i or. ;r.ub L =jo t^inaiuM ^TM dPU by^^ab^inij STM seems iniposjibl 



m\ copv Ammii ' 

thon visual Infurnmijun must undtH'^o an auditory transi'omalloii in STM 
bet Of o it roautitji. lony tarm nwmory (LTM). Such n notion is hafdiy 
Lonjblu>for inlonnutiun in LTM is* not *5Xclusivcly formed of ijuditory codes. 

STM, & bnef phenamtsnon ptesumtibly taking place before infurmation 
reach ino the CMS, is dopendunt upon tl»e patterned operations of neuronal 
cirtuitsi running complox reentrant pathways in the cerebral cortex. By 
;>yiujptic connect Ions, impulses traverse neurons weaving a pattern in 
space £ind timw, and carry information. That is the dynamic engram as defined 
Uy Ljshley (Eccles, 1973, P. 176). It is neither auditory, nor visual, 
nor audiovisual, but an inteorated j^ystem to synthesize afferent 
information. If STM is auditory, it stands to n^ason that by chemical 
und electrical (mostly chemical) impuleses, LTM may be of auditory as well. 
There is an absolute lacking or evidence to Indicate that LTM is of 
uiLhe-.r auditory or visual. It seems man's extreme dependency upon 
linyuiblic communication has misled him to believe that ST.-I might be 
aud i tory . 

The most probable and plausible answer for the assumption of auditory 
STM -.oems to lie in the fact that in the Indo-European language family 
In whicn alphnbets are used, the error committed in communication is 
inevitably associated with auditory characteristics. Difficult it may 
seen; to explain why the Chinese cannot ur.'erstand a Chinese classic being 
i-ejd dioud to him, db','must visualize it in listening before comprehension 
takes place. But suffice it to say, cMTors made in verbal communication 
;.-.icjht be of auditory nature, whereas in visual communication as the case 
with the Chinese, errors miyht very well possess visual characteristics. 
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In auUiovisuul iiitoniwtion process ifu^ os ifif hi cnt^t'U by tluj roUuiukuicy 
rcjte of tiCR. Tlub sUaiy w.;}b urului'luKijn to uxaminG tho clifferoiU lovols 
of bCK, anu mo extent ot its faci 1 i ccit lug vi'i't'octs on information proccbii- 
infj. F'or tin cxplorotory purpose, the pus it ion of auvllovisual synchrojii- 
.!atiun of auditory or vIsu»H retluncl«int information to tlio other cliiinncil 
wijs to bo cxiiiuincd in order to ascertain if there was any difference 
uetween redundant i nioroi^t ion vU the bevjinnintj and the end (termed primuey- 
rcourulwincy and recency-redundancy i-especti vely) . 

In the meantime, it was also attempted to explore whether STM was 
an auditory system rather than an inteyi'ated syfitum ihat could be detected 
oy alterriatlny auditory and visual as the eominanl and redundant channel. 
oTM as an auditory system could be supported only when the auditory dominant 
channel with redundant visual information would be found significantly 
Detter than the visual dominant channel with redundant auditory Information, 
while other factors were held constant. 

MLThOD 

A series of audiovii>ual recall tasks composed of Jiyits and lellcrh 
(except vowels) witn four decjrees of dCK <il Uie 15> i^O, 75 -and 100 per 
cent levels was tested. All diijits ^ifui Iciti.T'. u'.od js stimuli were 
randomly selected i nd i v i did I ly item a pile u( s|H'vJ.illy ivudu cards. The 
auditory and visual clumnels were lok^-n in i.nn to bo the do.ninant channel 
und the other the redundant chunnel Iw proviUc leUiuulun: i n < orma t i on for 
the dij'uiiuinf channel. blimuli v^ete .i '.rrii-s wf 2, ^, S and 12 diqil.:, 
or letters. Take the A-cliqiL or letter trial., t'n cx.iiiip 1 e , it the 
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viomhujfU channul Is aiuUlury, the rcKiurul»uU thannisl li. viiuiiil, thuu ttwj 
auuiUM:v ciwnnwl pio'^uitiuu Ui« whoU) full four Uuor or lour cJlijiu, 
in« vl?.ual t)i^is«3f>tcHl one, two, Uucu, or IVur UUjiU or Vu«r loUtiri>, lu 
ruprusont 'jO, 7$ or 100 per t;ant audioviQual BCH. 

The muxlmuni loiigth ol ditjifj or letlei'y vm'u Mii U, conu iilc>r iiuj 
that humn intonikil iuii procossifuj capacity vj^ns st-vun pluii or minub two 
(MilkT, 1956). In uduition to tiK^ vlistinction batwoon the tloiniiuiiU 
(iuiJ rodunduiU channels, toi.r mor^d condltiunsi vvtM'c admi n turud: 

(a) ThtJ auditory iu x/100 rodunuunt x is 2'j, ^0 or '/f^U 

the bovjinning portion of thi> visual irn'ornutioti, labglod uii A « 2!.V, 50/ 
or 7:^/ of V; 

(b) Thu auditory iS) x/lOO roduiidiinl ut th« tsndiiuj portion of tht visual 
information, labulod dii /25, /!)0 or of V; 

^c) and (d) aro tho revtarsi-jl of chunnv^lb in (a) and (b), labelled <3ti 
V 50/, or 75/ of A; und V - /25, /!>0 or 775 of A, robpect i ve ly . 

iNeealuss to say, with the 100 ICR, A "V and V A. Both (a) and 
(b) were designated as tho jud i tory-domin^mi-vlsual-rodundant (ADVR) conal- 
tion, and (c) and (d) the vi^iuai-dominani-audi tory-redundijnt (VDAR) condi- 
tion. 

For (ij) cjnd (c) , u II iriuls with ijO/ ond 75/ labels were dubiyncited 

u'.> Iho pr i "KH.y - rt'dundiinty condition, ind'CtUincj the rcdundtint information 
10 be coincided with the beyinni'ic] poriion v\ Uie dijininunt channel. Tor 
lb) .ind (u') , jll trails with /'ij'O <3iui /7!> weie (.ie., i gnatcd the 

roct.'ncy-reUundancy condition, indicutiiK) Uie reflund.iiir information coincided 
vn th the ending portion ot Uie dumin<jnt, cImiuh-I. lot rxami)le, if lUiditury 
is (Joiiiiuint ond vi'.ui..il redundant, for Uie 3-iri,il wilh V " 2b/, t hi> 
aud iov i 'ju.i I stimuli wen- ; 
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and wl th V = /25! 
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In ull prQS0uULion5, iiud iov I buj 1 i n rorm;»t i on wau synchronised and 
pfti&onioJ sirtiul tancou^ ly. Visual stimuli wuru projccUd on tho sureun 
syichronized by a Uher tape recorder which automatically controlled both 
speed and presentation. The speed was bai,ed upon the nonikil converycUlon 
speed at about 150 words-per-mi nu te. 

Subjects were 2k high-school junlor<>, each was pcud $1.50 per hour 
plus lunch. A 30-m!nute training session wos staged to familiarize Ss with 
the inimediate recoil tests by paper and pencil. Between tasks, for 
exijnple, of letters ond digits, there was a five-minute break In an attempt 
to ureak the monotony ond to reduce mentul fatigue of performing the 
recall lasks. The visual cue for Ss to begin the trial was 2 blank slide 
.vnere^i the auditory cu;- was a period of silence. The silence period and 
time for the visual blank depended the length of the stimulus materials. 



RESULTS 

wlH-n the amount of input into.mvUioD was low, the superiority ot 
s iiiiu 1 loneou>, audiovisual pi osen tat i on wos nui necessarily manifestable, 
Only when the input inturmation wub above a certain level, audiovisual 
synchronised stimuli were recalled better than a single channel presentation 
with the least amount uf oou i voriu t i on ( i n I o rma t i on loss) and noise (error) 
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(Hsid, 1968£i, b). With input nimuli of eitliet 2 or digits, theiu was 
pruUi.Uiibly nu s itjiii t i c.n\l ill ficrc.co dinontj d i i roi ent Iwvuls of BCR 
rugarJless ol wliuthwr the dudito.-y or viiiu«l wcis the dominant channel or 
the rgdundcint channel (Tdble 1). 

With tht? B-dlfjiL Input, no sicjnifiojnt differences among all levels 
of DCR was found, but yeneriilly the visual-dominant-auditory-redundant (VDAR) 

wuvi found better thdn tho wiudi tory-dominant-v isual-redundant (ADVR) . 
While the stimulus digits Increased to 12, there was appreciably signlflcani 
difference at all different BCR levels. Results shown in Table 1 were 
exactly as could be predicted: the level of 6CR was directly related to the 
accuracy of recall. The more redundant in BCR, the better recall. Significant 
differences were found betwen 100^; and 25<'. BCR and between 75% and 25"'!'' BCR for 
all trials and cond i t i ons ,even tlnough the SO-^ BCR yielded significant 

difference only in two of the four comparisons with the 751 BCR. 



Table 1 About Here 



Comparisons between ADVR and VDAP were significant in the recency- 
redundancy conditiun and not s i gn i f i c<ifi L in tho pi i indcy-redundancy 
conoition. In the otht.'r word-.i, VDAR- rectincy was, signficantly better 

than ADVR-rccency . It nujy be assumed that Lhe visual channel as the 
dominant cliannc I was superior Lo the ouJilory os the dominant channel 
when Iht; redundant infornwtior. wcj;. [iresented at, the terminal of the dominant 
channe 1 . 



Data in Table 1 might not be conclusive to establish the visual 
as a better channel actiny as the dominant channel « it throws doubts 
on the hypothesis that the auditory is the dominant channel lOr human 
information processing as argued by a host of e^perimentors, to which 
we shall return later on* 

In comparison between primacy-redundancy and recency-redundancy for 
the 12-digital trials, significant d i f ference was found beyond the .01 
level whereas for the 8-digital trials, no significant difference was 
detected. Again, it might not be authoritatively concluded to consider 
primacy-redundancy more effective than recency-redundancy; however, it 
is safe to assume that primacy-redundancy facilitated information processing 
when input stimuli had a high amount of information. l>lo significant 
differences were found for the 2 and 4-dlgit trials In ADVR and VDAR 
or primacy-redundancy and recency-redundancy comparison which therefore 
was omitted from Figure K 



Figure 1 About Here 



In the letter-recall tasks, the BCR effect was neatly split between 
the VDAR and ADVR conditions: BCR made no significant contribution to the 
effectiveness of communication under the VDAR condition; but on the other 
hand, it was unquestionably an effective means for the improvement of 
information processing under the ADVR condition. Of many available 
explanations, the more plausible one is: the visual dominant channel 
with auditory redundant information provided Ss v^ith better rehearsal or 
back-scanning, and therefore, there was no room for BCR to improve any 
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more, as can be readily seen that t:iere was no significant difference 
between 100^. BCR (X = 11) and other liCRs. In ADVR, however, the rehearsal 
or back-scanning was limited to the portion of visual information; there- 
fore, the higher BCR, the better result was tor the recall tasks. Once more, 
no significant differences existed among all conditions and treatments 
for the 2- and 4-leter recal 1 tasks (Fi gure 2) . 



Table 2 About Here 



In the letter-recall tasks, some conflicting evidence concerning 

primacy-redundancy and recency-redundancy was found, as there was no 

di fference whatever between differently positioned redundant Information, 

Comparisons between VDAR and ADVR was found significant across all levels 

of BCR, indicating that the visual presentation with auditory redundant 

information was tetter than the auditory presentation with visual redundant 

information and that the results support the findings of the digital 

tasks. This evidence raiseo serious question ribuuL the hypothesis on 

STM being an auditory system. 

If STM is auditory, then ADVR should huve bcvn a better performer 

aud i tory 

than VDAR; for ADVR t ransmi ts , 'n f ormcU ion to be recalled in Its entirety 
and thus involves no vl sua I ~to-aud i tory transformation whereas VDAR which 
transmits visual information in its entiruiy has lo yo through some 
transformation, and is therefore prone to the intrusion of noise and 
also equivocation. In this study, however, VDAR wuS found invariably 

better than ADVR. It seems tc; indicate lhat STM is hardly an auditory 
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system, nor must information prior to its entry to STM go through 
an visual -to-audi tory or audi tory-to-visual transformation. More likely, 
STM Is an Integrated system, taking Information from many different 
modalities, rather than oriented to a particular modality. 



Figure 2 About Here 



Pi scuss ion 

BCR in the present study seems to have established its usefulness in 
information processing, whether it is based upon the hypotheses of energy 
integration (summation and cumulative strength), cuing, multiple traces, 
or lower threshold. tach explains certain aspects of BCR functions, 
but none describe BCR completely. Possible but not absolutely certain, 
dCR possesses the combinational functions of multiple traces, cuing and 
summation so that information processing was facilitated. To comprehend 
ail the phenomena of multiple traces, cuing, energy Integration, summation and 
lower threshold hypotheses of bisensory information processing. It is 
necessary to delve into psycho-physiological and neurological studies, 
that however is beyond the scope of this paper. 

Within a limited range, man has* been found to be capable of 
procebbincj simultaneous messages from different modulities (Mowbray & Gebhard, 
1961). In reaction time studies, mu It i p 1 e- i races , cuing and summation can 
be studie^; however, of all these studies, the present study included, 
none caii solve all problems in modality information processing. Unless 
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the brain can be studied as the heart, opened, removed and kept alive, 

iTOdality studies may remain a speculative adventure, because we can 

only manipulate input (stimulus), examine output (response), and then 

speculate to the best of our knowledge about what has happened inside 

the black box. The only non-speculative thing about BCR is: BCR 

does provide for the auditory or visual attenders whatever they prefer as 

found by Ingersoll and Di Vesta (1972). 

One word of caution is in order: Despite the adaptability of BCR to 

theoretical concepts supporting the superiority of ajdbvisual simultaneous 

presentation, only slight dissynchronizat ion or time-lag between auditory 
and visual is likely to cause bisensory interference instead of facilitation 

in information processing. BCR is also extremely time-consuming in its 
preparation, particularly for its synchronization. From a pragmatic 
viewpoint, BCR is conceptually a simple device to increase the effectiveness 
of communication. Its implication in teaching-learning and communication 
is almost self-explanatory. From a theoretical viewpoint, BCR has perhaps 
pointed out that man's memory systems are of neither visual, nor auditoi-y, 
but integrated, but we have no idea how it is integrated. Therefore, 
the superiority of VDAR over ADVR may very well be due to the fact that 
VDAR prebented a more flexible rehearsal strategy as found by Sherman and 
Turvey (1969) rather than that STM is a visual system. It is entirely possible 
that tfiere are two or more separate memory systems as indicated by 
Murdock and Walker (1969) and Nilssen (1973); auditory and visual information 
Is handled by different memory systenv,. 

The conflicting findings on primacy-redundancy and recency-redundancy 
has no simple explanation. Why primacy-redundancy effects were found 
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only in the digital recall task but not in the letter-recjl 1 task 
raiseb many questions for which the present study has no answer based upon 
evidence so far obtained. Probably letters were more integratable in 
either auditory or visual form than digits when entering STM. It is 
plau':.ible but not proven that the drastic difference in auditory and 
visual presentation of digits, for example, 3 in the visual but "three" 
in the auditory, may account for the effect under the primacy- 
redundancy condition in the digital tasks. Under the recency condition, 
the redundant channel might have introduce interference when portion 
of the redundant information was superimposed on the mi idle of the 
dominant channel. Undertandably, this study raised more questions 
than solutions it set out to provide. 



Table 1 



Means* of Audiovisucii Between- Channel Redundancy of 
Four Levels (25, 50, 75 and 100%) in Digital Recall Tasks with the 
Auditory and Visual as the Dominant and Redundant Channels 



No. o 

Auditory 


£ Digits 
Visual 


2 


4 


8 


12 


100 


100 


1.898 


3.761 


7.478 


10.159 


75/ 


100 




3.671 


7.761 


10.198 


50/ 


100 


1.988 


3.943 


7.295 


10.114 


V 25/ 


100 




3.488 


7.386 


9.580 


A /75 


100 




3.671 


7.614 


9.614 


R /50 


100 


2.000 


4.000 


7.114 


8.512 


/25 


100 




3.475 


7.114 


8.398 


100 


75/ 




3.692 


6.559 


10.606 


100 


50/ 


2.000 


3.591 


6.468 


10.178 


A 100 


25/ 




3.796 


6.534 


8.682 


D 

V ijo 






3.568 


6.671 


8.556 


R 100 


/50 


1.977 


3.955 


6.511 


6.613 


100 


/25 




3.409 


6.682 


6.466 



Composite grand means for 10 trials. 



Hat eopr Mv;uUii5iE 



12 ^ 

10 



12-digit trials 



8 
6 

4 I 

2 



D=.889* 



D=.781* 



8-digit trials 



VDAR 



ADVR 



12 
10 
8 i. 

6 i 

4 
2 



12-digit trials 



D=1.867** 
r.= .05O n.s. 



8-digit trials 



Primacy Recency 
Redudancy 



** p< .01; 



p ^ .05; n.s. Not significant 



Figure 1 Comparisons between VDAR and ADVR and between Primacy- 
Redundancy and Recency-Redundancy in 8- and 12-digital 
Recall Tasks with Audiovisual Between- Channel Redundancy 



Table 2 



Means of Audiovisual Between-Channel Redundancy of 
Four Levels (25, 50, 75 and 100%) in Letter-Recall Tasks with the 
Auditory and Visual as the Dominant and Redundant Ch 



No. of Letters 
Auditory Visual 


2 


4 


8 


12 


100 


100 


1.977 


3.829 


7.329 


11.000 


75/ 
50/ 
25/ 


100 
100 
100 


2.000 


3.887 
3.773 
3.909 


7.602 
7.557 
7.727 


10.875 
10.500 
10.306 


/75 
/50 
/25 


100 
100 
100 


1.965 


3.989 
3.750 
3.796 


7.818 
7.580 
7.671 


10.853 
10.704 
10.807 


100 
100 
100 


75/ 
50/ 
25/ 


2.000 


3.886 
3.841 
3.943 


6.534 
5.329 
4.977 


9.352 
6.625 
5.170 


100 
100 
100 


/75 
/50 
/25 


2.000 


3.796 
3.762 
3.829 


5.989 
5.421 
4.875 


7.836 
6.546 
5.307 



* Grand means for 10 trials. 



mi COPY AVAILABLE 



12-letter trials 




D=3.95** 
D=2.13** 



8-letter 



trials 



VDAR 



ADVR 



p ^ .01 



12 
10 

s i 

6 

4 4. 

2 



12-letter trials 



D=-.038 



D=.a53 



8-letter trials 



Primacy Recency 
Redundancy 



Figure 2 Comparisons between VDAR and ADVR and between Primacy- 
redundancy and Recency- redundancy in 8- and 12-letter 
Recall Tasks with Audiovisual Between Channel Redundancy 
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